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Abstract 

We investigate the power of graph isomorphism algorithms based on alge¬ 
braic reasoning techniques like Grobner basis computation. The idea of these 
algorithms is to encode two graphs into a system of equations that are satis- 
fiable if and only if if the graphs are isomorphic, and then to (try to) decide 
satisfiability of the system using, for example, the Grobner basis algorithm. 

In some cases this can be done in polynomial time, in particular, if the equa¬ 
tions admit a bounded degree refutation in an algebraic proof systems such as 
Nullstellensatz or polynomial calculus. We prove linear lower bounds on the 
polynomial calculus degree over all fields of characteristic ^ 2 and also linear 
lower bounds for the degree of Positivstellensatz calculus derivations. 

We compare this approach to recently studied linear and semidefinite pro¬ 
gramming approaches to isomorphism testing, which are known to be related 
to the combinatorial Weisfeiler-Lehman algorithm. We exactly characterise the 
power of the Weisfeiler-Lehman algorithm in terms of an algebraic proof system 
that lies between degree-fc Nullstellensatz and degree-fc polynomial calculus. 

1 Introduction 

The graph isomorphism problem (GI) is notorious for its unresolved complexity 
status. While there are good reasons to believe that GI is not NP-complete, it is 
wide open whether it is in polynomial time. 

Gomplementing recent research on linear and semidefinite programming ap¬ 
proaches to GI [U [ini ESI EHl [20] , we investigate the power of Gl-algorithms based 
on algebraic reasoning techniques like Grobner basis computation. The idea of all 
these approaches is to encode isomorphisms between two graphs as solutions to a 
system of equations and possibly inequalities and then try to solve this system or 
relaxations of it. Most previous work is based on the following encoding: let G^Ji 
be graphs with adjacency matrices A, R, respectively. Note that G and H are iso¬ 
morphic if and only if there is a permutation matrix X such that AX = XB. If 
we view the entries Xy-w of the matrix X as variables, we obtain a system of linear 
equations. We introduce equations forcing all row- and column sums of A to be 1 


1 


and add the inequalities x^w > 0. It follows that the integer solutions to this system 
are 0/1-solutions that correspond to isomorphisms between G and H. Of course 
this does not help to solve GI, because we cannot find integer solutions to a system 
of linear inequalities in polynomial time. The first question to ask is what hap¬ 
pens if we drop the integrality constraints. Almost thirty years ago, Tinhofer |23j 
proved that the system has a rational (or, equivalently, real) solution if and only 
if the so-called colour refinement algorithm does not distinguish the two graphs. 
Colour refinement is a simple combinatorial algorithm that iteratively colours the 
vertices of a graph according to their “iterated degree sequences”, and, to distin¬ 
guish two graphs, tries to detect a difference in their colour patterns. For every 
k, there is a natural generalisation of the colour refinement algorithm that colours 
/c-tuples of vertices instead of single vertices; this generalisation is known as the 
k-dimensional Weisfeiler-Lehman algorithm (k-WL). Atserias and Maneva [I] and 
independently Malkin m proved that the Weisfeiler-Lehman algorithm is closely 
tied to the Sherali-Adams hierarchy [22] of increasingly tighter LP-relaxations of 
the integer linear program for GI described above: the distinguishing power of k- 
WL is between that of the {k — l)st and kth level of the Sherali-Adams hierarchy. 
Otto and the second author of this paper m gave a precise correspondence be¬ 
tween k-WL and the nonnegative solutions to a system of linear equations between 
the {k — l)st and kth level of the Sherali-Adams hierarchy. Already in 1992, Gai, 
Fiirer, and Immerman had proved that for every k there are non-isomorphic 
graphs Gk,Hk (called CFI-graphs in the following) of size 0{k) that are not distin¬ 
guished by /c-WL, and combined with the results of Atserias-Maneva and Malkin, 
this implies that no sublinear level of the Sherali-Adams hierarchy suffices to decide 
isomorphism. O’Donnell, Wright, Wu, and Zhou |2U| and Codenotti, Schoenbeck, 
and Snook m studied the Lasserre hierarchy [T8| of semi-dehnite relaxations of the 
integer linear program for GI. They proved that the same CFI-graphs cannot even 
be distinguished by sublinear levels of the Lasserre hierarchy. 

However, there is a different way of relaxing the integer linear program to obtain 
a system that can be solved in polynomial time: we can drop the nonnegativity 
constraints, which are the only inequalities in the system. Then we end up with a 
system of linear equalities, and we can ask whether it is solvable over some finite 
field or over the integers. As this can be decided in polynomial time, it gives us 
a new polynomial time algorithm for graph isomorphism: we solve the system of 
equations associated with the given graphs. If there is no solution, then the graphs 
are nonisomorphic. (We say that the system of equations distinguishes the graphs.) 
If there is a solution, though, we do not know if the graphs are isomorphic or not. 
Hence the algorithm is “sound”, but not necessarily “complete”. Actually, it is not 
obvious that the algorithm is not complete. If we interpret the linear equations over 
F 2 or over the integers, the system does distinguish the CFI-graphs (which is not 
very surprising because these graphs encode systems of linear equations over F 2 ). 
Thus the lower bound techniques applied in all previous results do not apply here. 


2 


However, we construct nonisomorphic graphs that cannot be distinguished by this 
system (see Theorem I6.4p . 

In the same way, we can drop the nonnegativity constraints from the levels of the 
Sherali-Adams hierarchy and then study solvability over finite fields or over the inte¬ 
gers, which gives us increasingly stronger systems. Even more powerful algorithms 
can be obtained by applying algebraic techniques based on Grobner basis computa¬ 
tions to these systems. Proof complexity gives us a good framework for proving lower 
bounds for such algorithms. There are algebraic proof systems such as the poly¬ 
nomial calculus [9] and the weaker Nullstellensatz system [3] that characterise the 
power these algorithms. The degree of refutations in the algebraic systems roughly 
corresponds to the levels of the Sherali-Adams and Lasserre hierarchies for linear 
and semi-definite programming, and to the dimension of the Weisfeiler-Lehman al¬ 
gorithm. We identify a fragment of the polynomial calculus, called the monomial 
polynomial calculus, such that degree-/c refutations in this system precisely charac¬ 
terise distinguishability by fc-WL (see Theorem 14.41) . 

As our main lower bounds, we prove that for every field F of characteristic ^ 2, 
there is a family of nonisomorphic graphs Gfc, Hj. of size 0{k) that cannot be distin¬ 
guished by the polynomial calculus in degree k. Furthermore, we prove that there is 
a family of nonisomorphic graphs Gk,Hk of size 0{k) that cannot be distinguished by 
the Positivstellensatz calculus in degree k. The Positivstellensatz calculus m is an 
extension of the polynomial calculus over the reals and subsumes semi-definite pro¬ 
gramming hierarchies. Thus, our results slightly generalise the results of O’Donnell 
et al. |2Uj on the Lasserre hierarchy (described above). Technically, our contribution 
is a low-degree reduction from systems of equations describing so-called Tseitin tau¬ 
tologies to the systems for graph isomorphism. Then we apply known lower bounds 
mm for Tseitin tautologies. 

2 Algebraic Proof systems 

Polynomial calculus (PC) is a proof system to prove that a given system of (mul¬ 
tivariate) polynomial equations P over a field F has no 0/1-solution. We always 
normalise polynomial equations to the form p = 0 and just write p to denote the 
equation p = 0. The derivation rules are the following (for polynomial equations 
p G P, polynomials f,g, variables x and field elements a,b): 

_ ]_ _9 f_ 

p’ x‘^ — x' xf' ag + bf 

The axioms of the systems are all p G P and x'^—x for all variables x. A PC refutation 
of P is a derivation of 1. The polynomial calculus is sound and complete, that is, P 
has a PC refutation if and only if it is unsatisfiable. The degree of a PC derivation 
is the maximal degree of every polynomial in the derivation. Originally, Clegg 
et. al. [S] introduced the polynomial calculus to model Grobner basis computation. 
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Moreover, using the Grobner basis algorithm, it can be decided in time whether 
a given system of polynomial equations has a PC refutation of degree d (see m)- 
We introduce the following restricted variant of the polynomial calculus. A 
monomial-PC derivation is a PC-derivation where we require that the polynomial 
/ in the multiplication rule is either a monomial or the product of a monomial 
and an axiom. 

If we restrict the application of the multiplication rule even further and require / 
to be the product of a monomial and an axiom, we obtain the Nullstellensatz proof 
system [3]. This proof system is usually stated in the following static form. A Null¬ 
stellensatz refutation of a system P of polynomial equations consists of polynomials 
/p, for p € P, and gx, for all variables x, such that 

'^fpP + Yl 9x{x^ -x) = 1. 

peP X 

The degree of a Nullstellensatz refutation is the maximum degree of all polynomials 
fpP- 


2.1 Low-Degree Reductions 

To compare the power of the polynomial calculus for different systems of polynomial 
equations, we use low degree reductions [7]. Let P and R be two sets of polynomials 
in the variables X and T, respectively. A decree-(di, ^ 2 ) reduction from P to R 
consist of the following: 

• for each variable y G y a polynomial fy{xi,... ,Xk) of degree at most di in 
variables xi,... ,Xk € A; 

• for each polynomial r{yi,... ,yi) G R a degree-d 2 PC derivation of 

x{fyi ( 3:11 ,..., ), ... , fyi {x£l j ■ ■ ■ j X£/;^)^ 


from P. 

• for each variable y G y a degree-d2 PC derivation of 

fy(xi, . . .,Xkf - fy{xi, ...,Xk) 


from P. 

Lemma 2.1 ([T]). If there is a degree-{di,d 2 ) reduction from P to R and R has a 
polynomial calculus refutation of degree k, then P has a polynomial calculus refuta¬ 
tion of degree max(d 2 , kdi). 
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2.2 Linearisation 


For a system of polynomial equations P over variables Xi let be the set of all 
polynomial equations of degree at most r obtained by multiplying a polynomial in 
P by a monomial over the variables x*. Furthermore, for a system of polynomial 
equations P let MLIN(P) be the the multi-linearisation of P obtained by replacing 
every monomial • Xj^ by a variable Observe that if P U Q has a 

solution a, then so does MLIN(P) as we can set := Oi{xi^) ■ ■ ■ a{xi^). 

The converse however does not hold since a solution a for MLIN(P) does not have to 
satisfy a(X|Qft}) = a{X^g^j)a{X^ijy). The next lemma states a well-known connection 
between Nullstellensatz and Linear Algebra. 

Lemma 2.2 (|6j). Let P be a system of polynomial equations. The following state¬ 
ments are equivalent. 

(i) P has a degree r Nullstellensatz refutation. 

(a) The system of linear equations MLIN(P^) has no solution. 

This characterisation of Nullstellensatz proofs in terms of a linear system of 
equations (also called design [6]) is a useful tool for proving lower bounds on the 
Nullstellensatz degree. Unfortunately, a similar characterisation for bounded degree 
PC is not in sight. However, for the newly introduced system monomial-PC, which 
lies between Nullstellensatz and PC, we have a similar criterion for the non-existence 
of refutations. 

Lemma 2.3. //MLIN(P‘^) has a solution a that additionally satisfies 
a{XT^) = 0 Oi{Xp) = 0, for all vr C p, 
then P has no degree-d monomial-PC derivation. 

Proof. Let a be the assignment defined in the lemma and suppose for contradiction, 
that P has a monomial-PC refutation of degree d. We define s to be an evaluation 
function that maps that maps polynomials h of degree at most < d to elements in 
F. For field elements a G F, we let s{a) := a. If /i = Xj^ • • • Xj^ is a monomial we 
set s(xq---Xi^) := If h = is a polynomial we let s{h) := 

J2j ajs{xj). We now claim that s{h) = 0 for every polynomial h in the refutation. 
This leads to a contradiction, as we finally derive h = \ and s(l) = 1 by definition. 
We prove the claim by induction on the refutation. For the base case let h be an 
axiom. If h = € P, let b® fbe multi-linearisation of h. We have 

s{h) = ajs{xj) = aja{Xj) = 0, as a is a solution to the linearised equation. 
Furthermore, for axioms x? — Xi we have s(x? — Xi) = a(A|j}.) — a(Ajj}.) = 0. The 
induction step for follows immediately as s{ag -|- bf) = as{g) -|- bs{f). For 

the multiplication rule of monomial-PC there are two cases. First, if / is the 
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product of a monomial and an axiom, then Xif G P'^. Hence, the linearisation of 
Xif is in MLIN(P'^), and thus s{xif) = 0 as in the base case. If / = Xjj • • • Xi^ is a 
monomial, then = s(/) = 0 by induction hypothesis. By the additional 

requirement on the a, it follows that s{xif) = = 0. This finishes the 

proof of the lemma. □ 

2.3 Linear and Semidefinite-Programming Approaches 

In the previous section we have seen that degree-d Nullstellensatz corresponds to 
solving a system of linear equations of size n^^^\ which can be done in time 
Over the reals, this approach can be strengthened by considering hierarchies of 
relaxations for linear and semi-definite programming. 

In this setting one additionally adds linear inequalities, typically 0 < x < 1. In 
the same way as for the Nullstellensatz, one lifts this problem to higher dimensions, 
by multiplying the inequalities and equations with all possible monomials of bounded 
degree. Afterwards, one linearises this system as above to obtain a system of linear 
inequalities of size n^^^\ which can also be solved in polynomial time using linear 
programming techniques. This lift-and-project technique is called Sherali-Adams 
relaxation of level d |22j . 

Another even stronger relaxation is based on semidefinite programming tech¬ 
niques. This techniques has different names: Positivstellensatz, Sum-of-Squares 
(SOS), or Lasserre Hierarchy. Here we take the view point as a proof system, which 
was introduced by Grigoriev and Vorobjov m and directly extends the Nullstel¬ 
lensatz over the reals. A degree-d Positivstellensatz refutation of a system P of 
polynomial equations consists of polynomials fp, for p € P, and px, for all variables 
X, and in addition polynomials hi such that 

^ fpP + J2 - x) = '^ 

pGP a; i 

The degree of a Positivstellensatz refutation is the maximum degree of all polyno¬ 
mials fpp and hf. It is important to note that Positivstellensatz refutations can be 
found in time using semi-dehnite programming. This has been independently 

observed by Parrilo m in the context of algebraic geometry and by Lasserre [15] 
in the context of linear optimisation. 

Grigoriev and Vorobjov m also introduced a proof system called Positivstellen¬ 
satz calculus, which extends polynomial calculus in the same way as Positivstellen¬ 
satz extends Nullstellensatz. A Positivstellensatz calculus refutation of a system of 
polynomials P is a polynomial calculus derivation over the reals of 1 + Again, 

the degree of such a refutation is the maximum degree of every polynomial in the 
derivation. 
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3 Equations for Graph Isomorphism 

We find it convenient to encode isomorphism using different equations than those 
from the system AX = XB described in the introduction. However, the equations 
AX = XB can easily be derived in our system (see Example 13.11) . and thus lower 
bounds for your system imply lower bounds for the AX = XB-system. 

Throughout this section, we fix graphs G and H, possibly with coloured vertices 
and/or edges. Isomorphisms between coloured graphs are required to preserve the 
colours. We assume that either |y(G)| > 2 or \V{H)\ > 2. We shall define a system 
Piso{G, H) of polynomial equations that has a solution if and only if G and H are 
isomorphic. The equations are defined over variables Xvw,v S V{G),w € V{H). A 
solution to the system is intended to describe an isomorphism i from G to H, where 
Xvw !->■ 1 if i{v) = w and Xy^ 0 otherwise. The system Piso(G, H) consists of the 
following linear and quadratic equations: 


^ ^ ^VW 1 

= 0 

for all w E V{H) 

(3.1) 

veV{G) 

^ ^ ^VW 1 

= 0 

for all u E E(G) 

(3.2) 

we.v(H) 

XyyjX'ulyj' 

= 0 

for all v,v' E V{G),w,w' E V{H) 
such that {(u, w), {v',w')} is no local 
isomorphism. 

(3.3) 


A local isomorphism from G to H is an injective mapping vr with domain in V (G) and 
range in V(H) (often viewed as a subset of V (G) x V(H)) that preserves adjacencies, 
that is vw € E{G) Tr{v)7r{w) E E{H). If G and H are coloured graphs, local 

isomorphisms are also required to preserve colours. 

To enforce 0/1-assignments we add the following set Q of quadratic equalities 

Xyyy ” X = 0 for duW V ^ V{G),w € V(H). (3.4) 

We treat these equations separately because they are axioms of the polynomial 
calculus anyway. Observe that the equations (13.ip and (j3.2p in combination with 
(j3.4p make sure that every solution to the system describes a bijective mapping from 
V (G) to V(H). The equations (13.3p make sure that this bijection is an isomorphism. 
Thus, for every field F, the system Piso(G,//) U Q has a solution over F if and only 
G and H are isomorphic. 

The following example shows how to derive the equations from the system based 
on AX = XB from Piso(G, H). 

Example 3.1. Recall that A and B denote the adjacency matrices of the graphs 
A, B. Thus the equations from AX = XB are 

Xyly; ” Xyyjl = 0 (3.5) 

v'GN{v) w'gN{w) 
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for aWv {G),w E V (H). To derive (I3.5|) from Piso(G, H), we multiply (I3.2|) with 
for v' E N{v) and obtain Xy/y, — J2w' Xy'wXyy,' = 0. Adding equations (j3.3p . 
Xv'yjXyyj/ = 0 , for all w' 0 N{w), yields the equation Xy'y, — J2w'eN(w) Xv'wXyyj' = 0 . 
Adding these equations for all v' E N(v), we get 

'y ' Xy'w y ' y ' Xyl yjXyy,/ 0. (^’S) 

v^^N{v) v'^Niy) w^^N(w) 

Similarly, we can derive the equation 

^ ^ ^ ^ ^ ^ ^v'w^vw* — 0* (^•^) 

w'£N(w) w'(w) v'{v) 

Subtracting (j3.7p from (13.6p yields (j3.5p . Note that the derivation has degree 2. 


4 Weisfeiler-Lehman is located between Nullstellensatz and Poly¬ 
nomial Calculus 


To relate the Weisfeiler-Lehman algorithm to our proof systems, we use the following 
combinatorial game. The bijective k-pebble game on graphs G and H is played by 
two players called Spoiler and Duplicator. Positions of the game are sets n CV(G) x 
V{H) of size | 7 r| < k. The game starts in an initial position ttq. If |C(G)| ^ |C(Lr)| 
or if ttq is not a local isomorphism, then Spoiler wins the game immediately, that is, 
after 0 rounds. Otherwise, the game is played in a sequence of rounds. Suppose the 
position after the zth round is tt*. In the (i -|- l)st round, Spoiler chooses a subset 
TT C TTj of size | 7 r| < k. Then Duplicator chooses a bijection / : V{G) —>■ V{H). Then 
Spoiler chooses a vertex v € V(G), and the new position is vTi+i := tt U {(u, f{v))}. 
If TTi+i is not a local isomorphism, then Spoiler wins the play after (i -|- 1) rounds. 
Otherwise, the game continues with the (i-|-2)nd round. Duplicator wins the play if 
it lasts forever, that is, if Spoiler does not win after finitely many rounds. Winning 
strategies for either player in the game are defined in the natural way. 

Lemma 4.1 ([8l I16] L k-WL distinguishes G and H if and only if Spoiler has a 
winning strategy for the bijective k-pebble game on G, H with initial position 0. 

Observe that each game position tt = {(ui, tci),..., {v£, we)} of size i corresponds 
to a multilinear monomial Xy = Xy^^y^ ... Xy^y,^ of degree £] for the empty position 
we let X 0 := 1 . 


Lemma 4.2. Let ¥ be a field of characteristic 0. If Spoiler has a winning strategy 
for the r-round bijective k-pebble game on G, H with initial position ttq, then there 
is a degree k monomial-PC derivation o/x^o from Piso{G,H) overW. 


Proof. The proof is by induction over r. For the base case r = 0, suppose that 
Spoiler wins after round 0. If |F(G)| 7 ^ \V{H)\, the system Piso(G, iL) has the 
following degree-1 Nullstellensatz refutation: 


J2v£ViG) a {'^w£V(H) Xvw “ l) + Y.w£V(H) (I]«gF(G) — 1, 


where a = \V{G) — V{H)\. It yields a degree-1 monomial PC refutation of Piso(G',-fl) 
and thus a derivation of Xjtq of degree |7ro| < k. Otherwise, vro is not a local isomor¬ 
phism. Then there is a 2-element subset vr := {{v,w),{v',w')} C tto that is not a 
local isomorphism. Multiplying the axiom XywXv'w' = ^vr with the monomial 
we obtain a monomial-PC derivation of Xttq of degree |7ro| < k. 

For the inductive step, suppose that Spoiler has a winning strategy for the (r-|-l)- 
round game starting in position ttq. Let tt C tto with |7r| < A; be the set chosen by 
Spoiler in the first round of the game. We can derive Xj^o from Xtt by multiplying 
with the monomial Hence it suffices to show that we can derive Xtt in degree 

k. 

Consider the bipartite graph B on V{G) tt) V{H) which has an edge vw for all 
V G V{G),w € V{H) such that Spoiler cannot win from position vr U {(x,rc)} in 
at most r rounds. As from position tt. Spoiler wins in r -|- 1 rounds, there is no 
bijection / : V{G) —>■ V{H) such that {v,f{v)) € E{B) for all v € V{G). By Hall’s 
Theorem, it follows that there is a set S' C V{G) such that |A'^(S')| < [S’!. Let S 
be a maximal set with this property and let T := N^{S). 

We claim that N^{T) = S. To see this, suppose for contradiction that there 
is a vertex v G N^{T) \ S. By the maximality of S, we have N^{v) % T. Let 
w G N^{v) \ T. Moreover, let w' G N^{v) DT (exists because v G N^{T)) and v' G 
N^{w') n S (exists because T = N^{S)). Then by the definition of B, Duplicator 
has a winning strategy for the r-round bijective /c-pebble game with initial positions 
7 rU{(u', tc')}, 7rU{(u, tc')}, and 7rU{(u, tc)}, which implies that she also has a winning 
strategy for the game with initial position vr U {(x', tc)}. Here we use the fact that 
the relation “duplicator has a winning strategy for the r-round bijective /c-pebble 
game” defines an equivalence relation on the initial positions. Thus {v',w) G E{B), 
which contradicts w ^ N^{S). This proves the claim. 

By the induction hypothesis and the claim we know that (*) x-j^Xyw has a degree- 
k monomial PC derivation if v a S,w ^ T or v ^ S,w a T. Furthermore, we can 
derive 



'y ^ Xyw 
w£V{H) 



y ^ Xyw 
veviG) 


- 1 


(4.1) 


by multiplying the axioms (13.ip . (13.2p with x-^ and building a linear combination. 
By subtracting and adding monomials from (*), this polynomial simplifies to (|T| — 
|S'|)x 7 r. After dividing by the coefficient |r| — IS"! 7 ^ 0, we get Xt^. We can divide by 
|r| — |5| because the characteristic of the field F is 0. □ 

The following lemma is, at least implicitly, from m- As the formal framework 
is different there, we nevertheless give a proof. 

Lemma 4.3. Let ¥ be a field of characteristic 0 and k > 2. If Duplicator has a 
winning strategy for the bijective k-pebble game on G, H then there is a solution a. 
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of MLlN{Piso{G, H)^) overW that additionally satisfies a(XTr) = 0 a(Xp) = 0 
for all vr C p. 

Proof. For all £ < k, we define an equivalence relation on V(Gy U V{HY as 
follows; for I, I' E {G,H} and f'-tuples u = {ui ,..., Ui) E V{lY, u' = {u'l ,..., u'fi) E 
V{I'Y^ we let u u' if Duplicator has a winning strategy for the bijective fc-pebble 
game on {1,1') with initial position {{ui,u'i ),..., {u£,u'Y}. We call the equivalence 
class of a tuple u the type of u and denote it by tp(tt). Note that if tp(h) = tp('u') then 
the mapping {{ui,u'i ),..., (u£,m^)} is a local isomorphism (of course the converse 
does not hold). 

For / E {G,H} and u E V{lY we let 

t{u) := I tp(u) n V{lY\- 

It is easy to see that if ft = {ui,... ,ui) E V{lY and u' = {u'^,... E V{lY', 
then 

{ui,... ,M^} = {u'l,... ,'u^,} ^ t{u) = t{v!). (4.2) 

In particular, the function t is invariant under permutations. Also observe that for 
V E V{GY and w E V{HY, 

tp(h) = tp(t(;) => t{v) = t{w). 

Now suppose that Duplicator has a winning strategy for the bijective fc-pebble 
game on G, H. We define the desired solution a to MLIN(Piso {G,H)^) hy 

a{XY) = 1 


and for vr = {(uijtci),..., {vf,,wfij} C V{G) x V{HY, where £ <k 


a{X^) 


i _^_ 

^ t{vi,...,Vi) 


if tp(ui, ...,ve)= tp(t(;i, ..., Wi), 
otherwise. 


It follows from (j4.2D that a is well-defined. We need to prove that it satisfies the 


equations of MLIN(Piso(G', H)^): 



ve.v(G) 

for all w and tt of size tt < /c — 1 , 

(4.3) 

weV(H) 

for all V and tt of size tt < /c — 1, 

(4.4) 

c 

\ 

II 

o 

for all v,v',w,w' such that 
{{v,w),{v',w')} is no local iso¬ 
morphism and all vr of size tt < 
k-2. 

(4.5) 
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The equations (14.51) are satisfied, because if {(n, w), (v',w')} is no local isomorphism, 
then neither is vr U {{v,w),{v',w')}. Assuming vr = {{vi,wi),...,{vi,W£)} this 
implies tp(ui, ... ,V£,v, v') ^ tp(rci,..., W£, w, w') and thus 




To see that the equations (14.31) are satisfied, let vr = {(ui, rci),..., (u^, w^)} for some 
i < k — 1 and w G V{H). Let v = {vi,... ,Vi) and w = {wi, ..., wi). Iftp(n) 7 ^ tp(u;) 
then 

'y ' 'tTU{{v,w)}) Ck(Al7r) 0) 

v£V{G) 

and thus (14.3|) is satisfied. Otherwise, 


and 


vGV{G) 




1 

t{v) 


1 

t{w)' 


(4.6) 


v£V(G) 


E 

v^V{G) 

tp(j;i;)=tp(iD'U)) 


1 

t{ww) 


|{n G V(G) I tp(un) = tp(t(;rc)}| 
t{ww) 


(4.7) 


We observe that for v' with tp(n') = tp(ri;) we have 


|{n G V{G) I tp(nn) = tp(r(;t(;)}| = |{n G V{G) \ tp(n'n) = tp(t(;t(;)}|. 


This follows from the properties of the bijective pebble game. Thus 

|{n GV{G)\ tp(nn) = tp(u)u;)}| = (4.8) 

Equations (I4.6p ~ (j4.8p imply that a satisfies (j4.3j) . 

The proof that equations (14.4D are satisfied is symmetric. 

Thus we have indeed defined a solution for the system MLIN(Pigo {G,Hf). It 
remains to prove that this solution satisfies a(XTr) = 0 oi{Xp) = 0 for all n ^ p. 
So let p = {(ui,u;i),..., ivm,Wm)} and tt = {(ui,t(;i),..., {v£,we)} C p for some 
i < m < k. Then 


a{X^) = ^ 

tp{vi,. .. ,Vm) 7^ tp{wi, ... ,Wm) 

a{Xp) = 0. 

□ 
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Theorem 4.4. Let ¥ be a field of characteristic 0. Then the following statements 
are equivalent for two graphs G and H. 

(1) The graphs are distinguishable by k-WL. 

(2) There is a degree-k monomial-PC refutation of Piso{G, H) over¥. 

Proof. Follows immediately from lemmas 12.3114.21 and 14.31 □ 

We do not now the exact relation between Nullstellensatz and monomial-PC for 
the graph isomorphism polynomials. In particular, we do not know whether degree- 
k Nullstellensatz is as strong as the A:-dimensional Weisfeiler-Lehman algorithm and 
leave this as open question. In the other direction, we remark that, at least for 
degree 2 , full polynomial calculus is strictly stronger than degree -2 monomial-PC 
and hence the Colour Refinement Algorithm (see Example 14.51) . However, we believe 
that the gap is not large. Our intuition is supported by Theorem 16.21 which implies 
that low-degree PC is not able to distinguish Cai-Fiirer-Immerman graphs. Thus, 
polynomial calculus has similar limitations as the Weisfeiler-Lehman algorithm [ 8 ], 
Resolution [M], the Sherali-Adams hierarchy and the Positivstellensatz |20j . 



Example 4.5. Let G be the disjoint union of two triangles and P[ he a 6 -cycle 
as depicted in the figure, where the vertices 1,2 are green, 3,4 are blue and 5,6 
are red. G and H cannot be distinguished by the 2-dimensional Weisfeiler-Lehman 
algorithm. Thus Piso{G, H) has no degree 2 monomial-PC refutation. However, 
there is a degree 2 polynomial calculus refutation. 

Proof. Consider the axiom —1. As 3,4,5, 6 have different colours than 1 this 

simplifies to xii-|-xi 2 —1. Multiplying xii-|-xi 2 —1 with X 33 yields X 11 X 33 -I-X 12 X 33 —X 33 
and hence (*) X 11 X 33 — X 33 by subtracting the axiom X 12 X 33 . Similar, multiplying 
X 33 + X 34 — 1 with xii yields X 33 X 11 -|- X 34 X 11 — xn and hence (**) X 33 X 11 — xn. 
Subtracting (**) from (*) yields (1) xn — X 33 . Note that we have obtained (1) by 
considering the edges between blue and green vertices. We can proceed the same 
way for the other two colour pairs to obtain (2) X 55 — xn and (3) X 34 — X 55 . Now, 
adding (1), ( 2 ), and (3) yields (A) X 34 — X 33 . We multiply with X 34 (this step is not 
allowed in monomial-PC) to get X 34 — X 33 X 34 which simplifies to (*) X 34 by adding 
the axiom X 33 X 34 and subtracting X 34 — X 34 . In the same way we get (**) 2 : 34 , by 
multiplying (A) with X 34 . By subtracting (*) and (**) from the simplified axiom 
X 33 + X 34 — 1 and multiplying with —1 we have derived 1. □ 
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5 Groups CSPs and Tseitin Polynomials 

5.1 From Group CSPs to Graph Isomorphism 

We start by defining a class of a constraint satisfaction problems (CSPs) where the 
constraints are co-sets of certain groups. Throughout this section, we let P be a 
finite group. Recall that a CSP-instance has the form {X,D,C), where T is a finite 
set of variables, D is a finite set called the domain and C a finite set of constraints 
of the form {x,R), where x € and R C D^, for some k > 1. A solution to such 
an instance is an assignment a : X ^ D such that a{x) G R for all constraints 
{x,R) G C. An instance of a T-CSP has domain P and constraints of the form 
(x, Ay), where A < P^ and 7 G P^. We specify instances as sets C of constraints; 
the variables are given implicitly. With each constraint C = ((xi,..., x^), Ay), we 
associate the homogeneous constraint C = ((xi,... ,Xfc), A). For an instance C, we 
let C = {G I C G C}. 

Next, we reduce P-CSP to GI. Let C be a P-CSP in the variable set X. We 
construct a coloured graph G{C) as follows. 

• For every variable x G A we take vertices y^^^ for all y G F. We colour all 
these vertices with a fresh colour 

• For every constraint C = ((xi,..., Xk), Ay) G C we add vertices for all /? G 

Ay. We colour all these vertices with a fresh colour If /? = (/3i,..., /3k), 
we add an edge for all i G [k]. We colour this edge with colour 

M«. 


We let G{C) be the graph G{C) where for all constraints C G C we identify the two 
colours and 

Lemma 5.1. A T-CSP instance C is satisfiable if and only if the graphs G{C) and 
G{C) are isomorphic. 

Proof Let G = {V,E) := G{C) and G = {V,E) := G{C).^ Tei p : X ^ T he a 
satisfying assignment for C. We define a mapping f : V ^ V as follows: 

• For every x G X and y G F we let := (y(/?(x)“^)*'^^. 

• For every G = (xi,..., Xk, Ay) G C and every [3 = {(3i ,..., /3k) G Ay we let 

/(^(C)) := {S^p{xi)~^,...,SkP{xk)~^)^^^. 

To see that this is well defined, note that p{x) := [p{xi),... ,p{xk)) G Ay, 
because p satisfies the constraint C. Thus 

t3p{x)~^ = {/3ip{xi)~^,...,/3kp{xk)~^) G A. 
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It is easy to see that the mapping / is bijective. To see that it is an isomorphism, 
consider, for some constraint C = (xi ,... ,Xk, Ay) E C and some i £ [k], a vertex 
where (3 = (/3i,..., j3k) E Ay, and a vertex y(^d^ where y E T. Then 

To prove the backward direction, suppose that / is an isomorphism from G to G. 
We define an assignment (p : X hy 

(Here denotes the x-copy of the unit element 1 E T in the graph G.) To see 
that (/? is a satisfying assignment, consider a constraint G = (xi ,... ,Xk, Ay) E C. 

Let f3 = {/3i,...,(3k) with f3i = ip{xi). 

We need to prove that (3 E Ay. We have fi/31^’'^) = As 1 = (1,..., 1) E A, 
the vertex E V has edges to all vertices Thus the vertex /“^(l^^^) has 

colour and edges to the vertices (3^''\ This implies that = 

(y{C) fQj- some a E Ay and a = (/3i,..., j3k) = 13. □ 

Remark 5.2. The lemma shows that our construction of graphs G{C) and G{C) from 
a T-CSP gives a reduction from T-CSPs to coloured graph isomorophism. Clearly, 
this is a polynomial time reduction. Observe that for a fixed group P and a fixed- 
arity fc, the graphs G{C) and G{C) have a bounded colour class size., that is, there is a 
bound (of |r|^) on the maximum number of vertices of each colour. It is long known 
that the isomorphism problem for graphs of bounded colour class size is solvable in 
polynomial time mm- 

Interestingly, there is also a converse reduction. Let G, LI be a pair coloured 
graph where the colour classes have size at most ^. Suppose that there are m 
colours, and let Gi{G) and Gi{H) be the vertices of G,H, of colour i. Without loss 
of generality we may assume that \Gi{G)\ = |C'j(iL)| =: Lj, where I* < Suppose 
that Gi{G) = {vii ,..., Vii^} and Gi{H) = {wn ,..., Wil^}. Then an isomorphisms g 
from G to H can be described as tuples (yi,... ,ym) of mappings y* : [I] —[£]: we 
let g{vij) = Wi.y.i^jy, conversely for a given isomorphism g we choose yi(j) to be the 
j' such that g{vij) = Wiji if 1 < j < Li, and we let yi(j) := j if L* + 1 < j < i. 

This enables us to describe isomorphisms as solutions to an 5^-CSP instance 
(where Si denotes the symmetric group on [L]), with variables xi,... ,Xm and the 
following constraints: 

• for all i E [m] a unary constraint {xi,Pi), where 

Pi ■= {li e Si I yi(j) = j for all j > L*}; 
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for all i^i' G [m] (not necessarily distinct) a binary constraints {{xi, Xii), Rai) 
with 


Rii' = {(7*,7i') e I Vj e G [li^] : 

(vijViiji G E{G) < > GE{H)]. 


Observe that the Pi are subgroups of Si and the Ra/ are cosets of some subgroup 
of Sj (essentially the automorphism group of the subgraph of G with vertices in 
Ci{G) U Cii{G) and all edges between the classes). Hence this really defines an Si- 
CSP instance. It is easy to see that solutions to this CSP instance correspond to 
isomorphims between G and H. 

Dawar m observed that P-CSPs have a constraint language that admits Mal’tsev 
polymorphisms (see [5]). Such CSPs are known to be solvable in polynomial time H 
[5]. So we obtain a reduction from bounded colour class graph isomorphism to con¬ 
straint satisfaction for constraint languages with Mal’tsev polymorphisms. Such a 
reduction (essentially the same one as ours) has also been given in |17j . 

Example 5.3 (The Tseitin Tautologies and the CFI-construction). For ev¬ 
ery graph H and set T C V{H) we define the following Z 2 -CSP TS = TS{H,T). 

• For every edge e G E{H) we have a variable z^- 

• For every vertex v G V{H) we define a constraint C^. Suppose that v is 
incident with the edges ei,... ,6^ (in an arbitrary order), and let Zi := Zg^- 
Let A := {(fi ,... ,ik) G 1^2 I J2i=i p = 0} < We will also use the coset 
A (1,0,... ,0) = {(ii,... ,4) e I H = 1} If u ^ T, we let := 
(zi ,... ,Zk, A), and if u € T we let Gy := (zi,..., Zfc, A -|- (1,0,... ,0)). 

Observe that T5 is a set of Boolean constraints, all of them linear equations over 
the field F 2 ; they are known as the Tseitin tautologies associated with H and T. We 
think of assigning a “charge” 1 to every vertex in T and charge 0 to all remaining 
vertices. Now we are looking for a set F C E{H) of edges such that for every vertex 
V, the number of edges in F incident with v is congruent to the charge of v modulo 
2. A simple double counting argument shows that 7*5 is unsatisfiable if |T| is odd. 
(The sum of degrees in the graph (y{H),F) is even and, by construction, of the 
same parity as the sum |r| of the charges, which is odd.) 

It turns out that the graphs G{TS) and G{TS) are precisely the CFI-graphs 
defined from H with all vertices in T “twisted”. These graphs have been introduced 
by Cai, Fiirer, and Immerman [ 8 ] to prove lower bounds for the Weisfeiler-Lehman 
algorithm and have found various other applications in finite model theory since 
then. 
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5.2 Low-Degree Reduction From Tseitin to Isomorphism 


For every graph H and set T C V{H), we let be the following system of 

polynomial equations: 


— 1 = 0 for all e € E{H), 

1 + ' ^ek =0 for all u G T with incident edges ei,..., e^, 

1 - Zg, z, 


ei ^62 


(5.1) 

(5.2) 

■ Zg^ = 0 for all n € F (H) \ T with incident edges ei,..., e^. (5.3) 


Observe that for every field F of characteristic 7 ^ 2 there is a one-to-one corre¬ 
spondence between solutions to the system Pt^s{H,T) over F and solutions for 
the CSP-instance FS{H,T) (see Example I5.3p via the “Fourier” correspondence 
1 0,-1 1 -^ 1 . 


Lemma 5.4. Let ¥ be a field of characteristic 7 ^ 2. Let k > 2 be even and H a 
k-regular graph, and let T C V{H). Let G := G{TS{H,T)) and G ■.= G{TS{H,T)). 
Then there is a degree-{k,2k) reduction from Pts(^^, F) to Piso{G,H). 

Proof. Let us first simplify the notation. We let TS := TS{H,T) and Pts := 
Pts{H,P) and Piso •— Piso {H,P) 

We denote the vertices of H by t, u, the vertices of Ghy v,w and the vertices of G 
by V, w. It will be convenient to view the CSP as a P-CSP for the multiplicative 
group P = ({1,—I},-). Then the constraint Gt associated with vertex t is Gt = 
((zei ,... ,ZeJ,Zt), where 


= 


{(Ci,...,a) eii,-!}"^ 
{(Ci,...,Cfc) 


ntiO = -i} 

ntiC. = i} 


if t G T, 

if t G V{H) \ T. 


We let 

k 

I riCi=i} 

i=l 

for all t G V{H). Note that Zt = Zt precisely for the t G V{H) \ T. 

The graphs G and G have vertices and — 1 (^=) for e G E{H), which in 
the following we denote by 1^®^ and —Furthermore, the graphs have vertices 
^(Ct) fQj. f £ y{H) and C G or ^ G Zt, which in the following we denote by 
_ If (^ = (:^i,..., (i.) and t is incident with ei,..., Ck, for all i G [k] we have an 
M(*)-coloured edge 

To avoid excessive indexing, we write z(e) instead of Zg and x{v,v) instead of 
y^vv denote the variables of the polynomials in Pt's{H,T) and Piso{G, H). 

Now we are ready to define the reduction. Let us first define the polynomials fx 
for the variables x of Piso- 


• If X = x(C*'®\ for some e G E{H) and C,g & {1,-1}, we let 


fxiz{e)) = ^{1-Cgz{e)). 
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• If X = for some t E V{H), incident with edges ei, ... ,efc E E{H), 

and C = iCi, ■■■ ,Ck) & Zt,r] = {r]i,... ,r]k) G Zt we let 

k 

fxiziei),.. .,z{ek)) = n o(l “ CiVMei))- 

i=l ^ 


• For all other variables x, we let = 0. 

Now we need to prove that for each polynomial q{xi,..., X() E Piso U Q the polyno¬ 
mial q{fxi{z),..., fx({z)) has a degree 2k derivation from Pts- 

The polynomials x{v,v)‘^ — x{v,v) for v E V{G),v E V{G) 

We only have to consider the cases 

(i) V = V = for some e E E{H) and C^V ^ 

(ii) V = V = r/W) for some t E V{H) and C ^ Zt, rj ^ Zf. 

For all other pairs v € V{G),v e V{G) we have = 0 and thus fx(v,v) = 

0 , which makes it trivially derivable in the polynomial calculus. 

Let us consider case (i) first. We have 

fxiv,vM(^')^‘^ - fxiv,v)(^ie)) = i - ^Cvz{e) + ^C‘^r]‘^z{ef - ^ + ^Cvz{e) 

= ^{z{ef-l), (5.4) 

where the last equality holds because = 1- As z{e)‘^ — 1 is in Pts, this gives 

us a trivial degree-2 derivation of - fx(v,v)^^^^^^- 

Let us now consider case (ii). Suppose that t is incident with the edges ei,..., 
and that C = (Ci) • • • > Cfc) and rj = (rji,..., rjk). For i E [/c], we let Zi = z(ej) and 
fi{zi) = i(l - Cir]iZi). As in ([SllD, 

fiizif - fiizi) = ^{zf-1). (5.5) 

We have 

k k 

/x(^,F)(^l> • • - ^k? - /a;(^,,F)(^l> • • • > ^k? = n 

i=l i=l 

We prove that we can derive 11^=1 fi{ziY ~ Y\l=iP{^i) by induction on j. For j = 1, 
this follows from (15.5p . For the inductive step j — 1 —>■ j, we write 

Ylfiizi? -Ylfiizi) 

2=1 2=1 
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=n n +•/'i(^i) n n /*(^*) 

2 = 1 2 = 1 2 = 1 2 = 1 

= ifjizjf - fjizj)) n fiiZif + fj{Zj)(^Y[ fi{Zif - [| fi{Zi)). 

2=1 2=1 2 = 1 

If follows from (15.5|) that {fj{zjY—fj{zj)) can be derived. Thus {fj{zj)‘^—fj{zj)) nti fi{ziY 
can be derived as well. It follows from the induction hypothesis that Ilti fiiziY ~ 
nti fi{zi) can be derived. Thus fj{zj)(^ll{zl fi{zif - nti fi{zi)^ can be derived 

as well, which implies that 111=1 fiizi)'^ —111=1 fi{zi) can be derived. As none of the 
polynomials involved in these derivations has degree greater than 2k, this gives us 
a degree-2A: derivation. 

The polynomials x{v,v) — 1 for v €V{G) 

Suppose first that v = for some e S E{H) and C € {1,-1}, and let ry = —C- 
Then 

^fx{vZp) - 1 = /cw,cw(^(^)) + /cw,r?w(^(e)) - 1 = -7;C^z{e) - ^Cvzie) = 0, 

ZeViG) 

which is trivially derivable. 

Suppose next that v = for some t G V{H) and C = {Ci^ ■ ■ ■ Xk) £ Ef. 
Suppose that t is incident with edges ei,..., Cfc € E{H), and let Zi = z{ei). Then 

ZeViG) rieZt 

k 

=^ (^- 6 ) 

Observe that 

k k 

^HX-CiViZi) = liX-ViZi) ( 5 . 7 ) 

(r,i,...,%)gZt*=l (rii,-,Vk)€Zti=l 


Claim 1. Let f > 1, e € {1, —1}, and Z{^, e) = {(ryi,..., %) | 111=1 = c}. Then 

IlX - ViZi) = +i-l)X Y[ziy 

{vl,--;Ve)^Z{£,e)i=l i=l 
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Proof. We prove the claim by induction on 1. For £ = 1 it is trivial. For the 
inductive step — 1 —>■ t", we write 


{r)l,...,r)i)GZ(e,e) i=l 

£-1 £-1 
(1-ze) Y Ylil - ViZi) + (1 + ze) Y - ViZi) 

{rfi,...,r]e-i)eZ{£-l,e) i=l {rji,...,rie_i)eZ{£-l-e) i=l 

■ 2^ (il — zi){l + {—lY ^e'^Zi) + {1 + zi){l — {—lY 


i=l 


2=1 


2^-^{2 + 2{-lYei{zi 
2=1 


2=1 


Let Ci = — 1 if t € T and = 1 if t 0 T. As /c is even, by the claim we have 

k k 

*=i 


Then from (15.6p and (|5.7I) we obtain 

k k 

Y^ /xKF)(^)-l = -l + ^(l + etn^i) = (5.8) 

v£V{G) *=1 

As 1 — et nf=i Zi G Pts, this polynomial is derivable. 

The polynomials J2v£V(G) x{v,v) — 1 for v G V{G) 

This case is symmetric to the previous one. 

The polynomials x{vi,vi)x{v 2 ,V 2 ) for ui,U2 G V{G),vi,V 2 G V{G) such that 
{(ui, ui), (u 2 , U 2 )} is not a local isomorphism 

As = 0 unless Vi = and Vi = e G E{H) and G {—1,1}, or 

Vi = and Vi = for some t G V{H) and C, G G Zt, we assume that 

this is the case for i = 1, 2. In the former case we them e-vertices and in the latter 
t-vertices. In order for the mapping U 1 U 2 1 —)• U 1 U 2 to be no local isomorphism, the 
following may happen; 

(i) vi = V 2 and vi ^V 2 ', 
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(ii) vi / V2 and vi = V2; 

(iii) V1V2 G E{G) and viV2 ^ E{H); 

(iv) V1V2 0 E{G) and V1V2 G E{H). 

By symmetry, it suffices to consider cases (i) and (iii). 

In case (i), assume first that vi,vi are e-vertices. Then V2 = vi,V2 are e-vertices 

~ (e) ~ (e) 

as well. Say, vi = V2 = and vi = rjl ', V 2 = t]^' Vi 7 ^ ^2- Then 

= ^(1 - C^^(e))(l - mV2z{e)) 

= t(l-2(e))(l +2(e)) = 1 ( 1 -2(e)2). 

As z{e)‘^ — 1 G Pts) this polynomial is derivable. 

Assume next that ui,ui are t-vertices. Then V2 = vi,V2 are t-vertices as well. 
Say, vi = V2 = foi' some C = (Cii • • • iCfc) G Zt H Zt and Vi = for some 
li = {riii,-■ ■ iVik) G Zf. Then r]i r/2. Say, r]ik / mk- For all j G [k], let 
Zj = z{ej). We have 

/x(i;iTi)(^) • fxiv 2 Z 2 )(^) = ( n 9(1 - • ( n 9(1 - VljV 2 jZj)) 

J =1 i=i 

-y k—1 

= ^ ( n - CjZj){l - VljV 2 jZj)) (1 - Zk){l + Zk) 
k—\ 

= ^ (n - vijmjZj)) (1 - zl). 

As — 1 G Pts, this polynomial is derivable. 

In case (iii), Vi,Vi must be t-vertices and V3-i,V3-i must be e-vertices for some 
i G [ 2 ] and t G V{H),e G E{H) such that e is incident with t, because otherwise 
there will be no edges between either vi and V2 or vi and V2- 

Say, vi = for some t G V{H) and C = (Ci)---)Cfc) ^ Et, r] = 

{r]i,... ,rjk) G Zt and V 2 = C,^^\v 2 = for some e G E{H) incident with v and 
C,rj £ {—1, 1 }. Let ei,..., be the edges incident with t, and assume that e = e^. 
As V 1 V 2 G E{G), we have C = Ck, and as V 1 V 2 ^ E{G), we have r/ ^ rjk. This implies 
Qrj Cfchfc- For all j G [A:], let Zj = z{ej). We have 

/aiK,Li)(^) • /x(i; 2,L2)(^) = ( n 2^^ “ CiViZi)) ■ 2(1 - CVZk) 

2=1 

^ k—1 

= ^FTT n “ Cir]iZi){l - Zk){l + Zk) 
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k—1 

= “^fcTT n “ CiViZi)izl - 1). 

As — 1 € Pts, this polynomial is derivable. □ 

6 Lower Bounds 

We obtain our lower bounds combining the low-degree reduction of the previous 
section with known lower bounds for Tseitin polynomials due to Buss et al. [7] for 
polynomial calculus and Grigoriev m for the Positivstellensatz calculus. 

Theorem 6.1 ([3, 114] 1. For every n G N there is a 6-regular graph of size 
0{n) sueh that {Hn)) is unsatisfiable, but: 

(1) there is no degree-n polynomial ealeulus refutation o/PTs(17n, V{Hn)) over any 
field F of charaeteristic ^ 2; 

(2) there is no degree-n Positivstellensatz calculus refutation of PTs{Hn,V{Hn)) 
over the reals. 

Now our main lower bound theorem reads as follows. 

Theorem 6.2. For every n G N there are non-isomorphie graphs Gn, Gn of size 
0{n), sueh that 

(1) there is no degree-n polynomial calculus refutation of Piso{Gn, Gn) over any 
field F of charaeteristic 2; 

[2] there is no degree-n Positivstellensatz calculus refutation of Piso{Gn,Gn) over 
the reals. 

Proof. This follows from Lemmas 12.11 and 15.41 and Theorem 16.11 □ 

It follows that over finite fields, polynomial calculus has similar shortcomings 
than over fields of characteristic 0. However, a remarkable exception is F 2 , where 
we are not able to prove linear lower bounds on the degree. Here the approach to 
reduce from Tseitin fails, as the Tseitin Tautologies are satisfiable over F 2 . As a 
matter of fact, the next theorem shows that CFI-graphs can be distinguished with 
Nullstellensatz of degree 2 over F 2 . 

Theorem 6.3. Let H be a graph T C V{H) sueh that \T\ is odd. Then there is a 
degree-2 Nullstellensatz refutation over ¥2 of Piso{G,G), where G = G{TS{F[,T)) 
andG = G{TS{H,T)). 
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VoVi UoUi VqVi 




u'q u[ v'q v[ 



G (ceT) 


G{c^T) 


G 


Figure 1. Cai-Furer-Immerman Gadets for vertices of degree 3. 


Proof. For simplicity we assume that H is 3-regular. Our argument extends to 
graphs H of arbitrary degree. Recall that G and G contain a uniquely coloured 
pair of vertices uo,ui for every edge e € E[H). Furthermore, for every vertex 
t G V{H) incident with edges 61 , 6263 , there are 4 vertices Cq\ ..., 63 *^ (again of 
unique colour) that are connected to the vertex-pairs as shown in Figure 

[TJ Now we derive a an unsatisfiable system of linear equations over Z 2 with a 
polynomial calculus refutation of rank 1 and degree 2. Hence, there is a degree 
2 Nullstellensatz refutation, as satisfiability of this system can be refuted using 
Gaussian elimination over Z 2 . For every gadget as depicted in Figure [U we derive 

^UQu'g d” ^vqVq d~ ^wow'q d if c G F, (h’l) 

^uqUq d~ 0 if c ^ T. (h’ 2 ) 

By the definition of TS{H, T), this system is unsatisfiable if T is odd. We only prove 
the former case, the latter is symmetric since (as + = 1 ) it is equivalent 

to Xy^y'^ + ^vqv'q + ^wiw'g = 1- By employing (j3.3p for coloured graphs, we directly 
eliminate variables Xyy, where u and v have different colours. The derivation is 
shown in Figure El □ 

Thus, to prove lower bounds for algebraic proof systems over F 2 we need new 
techniques. Our final theorem, which even derives lower bound over Z, is a first 
step. 

Theorem 6.4. There non-isomorphic graphs G, H such that MLIN(Piso(G, 
has a solution over Z. 

Corollary 6.5. There non-isomorphic graphs G, H such that Piso{G, H) has no 
degree-2 Nullstellensatz refutation over Fg for any prime q. 
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1 ) 

^CqCq ^Cqc'^ ^CoC 2 ^CQCg 1 

axiom (j3.2p 


2 ) 

^WqWq^CqCq ^WqWq^CqC^^ 




~^^W0Wq^CQC2 ^WQWq 

mult, with 


3) 

^WQw'q^CQC2 ^ 

axiom 


4) 


axiom 


5 ) 

^WQWq^COCq “ 1 “ ^WQWq^CQc'^ ^WQWq 

(2) - (3) - (4) 


6 ) 

^wqWq ~I“ ^wqw'^ ^ 

axiom (13.21) 


7) 

^CQCq^WQWq ^COCq^Wow[ ~ ^CQCq 

mult, with Xgpc^ 


8) 


axiom 


9) 

^CQCq^WQWq ~ ^CQCq 

(7) - (8) 


10 ) 

^CQc'^^WOWq ^CQc'^ 

mult. ( 6 ) with 

11 ) 

^CQc'^^UJOW^^ 

axiom 


12 ) 

^Coc'^^WoIOq ^cqc'^ 

( 10 ) - ( 11 ) 


13) 

^CQCq + ^CQC[ ~ ^WQw'q 

(5) - (9) - (12) 


14) 

^CQCq “ 1 “ ^C0C2 ~ ^uqu'q 

analogous to ( 1 )... 

(13) with u 

15) 

^CQCq + ^CQCg ~ ^VQVq 

analogous to ( 1 )... 

(13) with V 

16) 

^UQUq ~I“ ^VQVq ~I“ ^WOWq ^^CQCq 1 

(1) - (13) - (14) - 

(15) 

16) 

^UQUq ~I“ ^VQVq ^WQWq ^ 

over Z 2 □ 



Figure 2. Derivation of (16.ip 
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For two graphs G and H, consider a colouring of the vertices of both graphs. 
We call such a colouring suitable, if 

(1) for every colour, the number of vertices of this colour is the same in both 
graphs, 

(2) the colour classes form independent sets in both graphs, and 

(3) the induced subgraph on two distinct colour classes has either no edge or is a 
matching between these two colour classes (and the shape is the same in both 
graphs). 

The index of a colouring be the product of all different colour class sizes. 

Lemma 6.6. Given G and H. If there are two suitable colourings with co-prime 
index, then MLIN(Pigo(G', has a solution overZ. 

Proof. For a colouring of index c, we define an integer assignment a to the variables 
of MLIN(Pigo(G, FF)^) as follows: 




0, if u and w have different colours, 

c/F, if F is the size of the colour class of v and w. 


(6.3) 


For the variables Xyw,v'w' we set 0({X.^w,v'w') = 0, if the colours of v and w or the 
colours of v' and w' differ. Otherwise, let Gi be the colour class of v and w and 
C 2 be the colour class of v' and w'. For a colour class C, denote by and G^ 
the vertices of colour C in G and FF, respectively. Now we fix two colour classes 
Cl and C 2 . Let Cf = {ui,..., vi}, = {u'^,..., v'^}, Cf = {tci ,... ,wi} and 
C 2 = {w'l,... If FFi = C 2 , it holds that I = m, Vi = v[ and Wi = w[. In 

the case that Ci and C 2 are distinct and the edge set forms a matching, we assume 
w.l.o.g. that the edges are {vi,v[} G E{G) and {wi,w'j^} G E{H) for 1 < i < i = m. 
In both cases let 


= |c/F, if i - a = j - b,0, otherwise. (6.4) 

In the remaining case that C^ and C^ are distinct and there are no edges between the 
colour classes, we let = cj{£m). This mapping ensures, that a(FF,r) = 

0, if TT is no local isomorphism. Furthermore, for the linearised 2-dimensional version 
of (|3.1I) and (13.2p we have 

a(FF{„«;}) = for all w'G I/(FF), and (6.5) 

v'eV{G) 

Q:(FF|^.y,|) ^ for all v G V{Gf (6.6) 

w'eV{H) 
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However, the linearised version (|3.ip and (I3.2|) itself we have 


a(A{^^}) = c, for all w € V{H), and 

(6.7) 

veViG) 


a(A{^^}) = c, for all v E V{G). 

( 6 . 8 ) 

weV{H) 



Hence, a is only a satisfying assignment if c = 1 (and in this case G and H 
are isomorphic). However, let 13 be the assignment constructed the same way out 
of a second suitable colouring with index b. If b and c are co-prime then there are 
integers s and t such that 1 = -|- tc. Thus, the assignment 7 defined by 


7 (X^) = s/3{X^) + ta{X^) 


satisfies all equations from MLIN(Piso 



suitable colouring of index 3 



suitable colouring of index 2 


□ 


Proof of Theorem B Let G be the disjoint union of three triangles and H be 
the disjoint union of a triangle and a 6 -cycle (with vertices wq,. .. ,W5 and edges 
{rcj, 6)})- First, we colour the three vertices of every triangle with the three 

colours C'o,Ci,C 2 . In the 6 -cycle, we colour Wi and Wi +3 with Gi (for i = 0,1,2). 
As every colour contains exactly three elements, this is a suitable colouring of index 
3. We now change the colouring and assign new colours G 3 , G^, C 5 to the triangle 
in H and an arbitrary triangle in G. Again, it is not hard to see, that this colouring 
is suitable and has index 2. Thus, by Lemma [6.61 MLIN(Piso(G, has a solution 
over Z. □ 


7 Concluding Remarks 

Employing results and techniques from propositional proof complexity, we prove 
strong lower bounds for algebraic algorithms for graph isomorphism testing, which 
show that these algorithm are not much stronger than known algorithms such as 
the Weisfeiler-Lehman algorithm. 

Our results hold over all fields except—surprisingly—fields of characteristic 2. 
For fields of characteristic 2, and also for the ring of integers, we only have very 
weak lower bounds. It remains an challenging open problem to improve these. 
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